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1.  Introduction 


The  general  linear  hypothesis  model  of  full  rank 
[Graybill,  1961]  can  be  written  as 


Y  =  x  6  +  e  , 
n*l  n*k  kxl  n*l 


e  ~  N  (0  ,o  1)  , 


where  Y  is  the  vector  of  n  dependent  variable  values  to  be 
observed,  X  is  the  "design  matrix"  of  fixed  values  of  the  inde¬ 
pendent  variables,  6  is  a  vector  of  unknown  fixed  coefficients 
in  the  model  and  e  is  the  unobservable  random  error  vector. 

The  i— —  row  in  this  matrix  equation. 


Yi  =  X0i80  +  3lXli  +  “•  +  6kXki  +  ei  ' 


represents  the  i —  dependent  value  to  be  observed  as  a  linear 
function  of  the  i—  set  of  independent  variable  values: 


X0i'  Xli' 


The  solution  to  the  normal  equations  for  estimating  3, 


(x'x) 3  =  x'y  , 


where  y  is  the  nxl  vector  of  observed  outcomes  on  Y,  can  be  found 

using  program  02  in  the  TI-59  master  module,  provided  x'x  is 

of  full  rank  k  and  1  <  k  <  9 .  Due  to  space  requirements  for 

computing  x'x,  the  program  presented  here  requires  k  <  8. 

Also,  because  of  optional  programs  (which  run  faster)  for  k  =  2 

(OP12-OP15  and  Z+)  and  k  =  3  (statistics  module  program  18) , 

the  programs  presented  here  are  most  useful  for  3  <  k  <  8 .  There 

is  no  limit  on  the  number  of  observations,  n.  Tests  of  hypotheses 

about  components  of  8  can  be  carried  out  using  a  "reduced  model" 

solution,  and  confidence  intervals  for  linear  functions  of  the 

-1  ~  2 

coefficients  can  be  obtained  using  (x'x)  and  a  ,  based 

on  the  t-distribution,  as  outlined  in  [1] .  Tests  and  confidence 

2  ~2  2 
intervals  for  a  can  oe  obtained  from  o  ,  based  on  the  x 

distribution. 


2 .  The  Programs 

Listings  of  two  programs  are  given  in  the  appendix. 

Program  #1  serves  two  purposes: 

(a)  computation  of  x'x,  x'y  and  y'y  as  rows  of  the  data 
matrix  (x  l  y)  are  entered; 

A  A  ^  1 

(b)  computation  of  8,  8'x'y  and  (x'x)  for  the  full  model. 
Program  #2  also  serves  two  purposes: 

(a)  computation  of  reduced  model  components  (x'x)r  and  (x'y)r, 
and  loading  them  into  memory: 

A 

(b)  computation  of  8^(x'y)r  for  the  reduced  model. 
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A  multiple  regression  problem  is  solved  with  these 
programs  following  the  sequence : 

(a)  load  Program  #1  (2  banks) 

(b)  enter  rows  of  the  data  matrix 

(c)  store  x'x  and  x'y  on  cards 

a  ~  -1 

(d)  compute  and  record  3,  3' x'y,  (x'x)  ,  y'y  and  x'y 

(e)  load  Program  #2  (1  bank) ,  along  with  the  stored  data 

(f)  compute  3^.(x'y)r  for  the  reduced  model. 

Steps  (c) ,  (e)  and  (f)  are  optional,  depending  on  whether  it  is 

desired  to  test  hypotheses  that  various  components  of  3  are 

a  -1 

zero.  Components  of  g  and  (x'x)  can  be  recalled  from 

memory  (or  listed  on  the  printer  using  the  "INV  LIST"  command) 
as  desired. 

Entering  each  row  of  the  data  matrix  and  updating  x'x, 

x'y  and  y'y  requires  from  30-60  seconds,  depending  on  k. 
a  -1 

Computation  of  g  and  (x'x)  requires  from  1  minute  to  12 
minutes,  again  depending  on  the  dimension  of  x'x.  In  what 
follows,  we  give  instructions  for  using  the  programs  in  the  TI 
program  record  format.  This  is  followed  by  an  annotated  example 
printer  output  (use  of  the  printer  is  optional) .  Program  list¬ 
ings  are  given  in  the  Appendix. 


3.  Instructions 

Instructions  for  running  the  programs  are  given  in 
Figures  1  and  2.  Using  the  quantities  computed  when  both  programs 
are  used,  an  "analysis  of  variance"  summary  can  be  constructed. 

The  format  of  this  table,  and  sources  of  its  entries,  are  given 
below,  in  Figure  3.  An  hypothesis  of  the  form  Hgig^  =  0  is 
tested  with  the  F  ratio  with  the  "g^  sum  of  squares"  in  the 
numerator  and  the  "error  mean  square" 

A 

-2  _  y'y  -  g'x'y 
n  -  k 

in  the  denominator.  Degrees  of  freedom  for  this  F  ratio  would 
be  1  and  n-k.  Note  that  the  sum  of  squares  due  to  regression 

A 

in  the  full  model,  g'x'y,  generally  is  not  partitioned  into 
independent  components  due  to  gQ,  g^  ...  ,  g  unless  the 
design  is  "orthogonal"  (x’x  is  diagonal) .  Thus,  tests  of 
several  hypotheses  about  components  of  g  are  generally  not 
statistically  independent.  See  [Searle,  1972]  for  a  discussion 
of  how  to  proceed  if  it  is  desired  to  test  several  hypotheses 
in  the  non-orthogonal  case. 

If  one  wishes  to  compute  the  coefficient  of  determination 

2 

R  (which  is  not  as  useful  as  the  related  F-ratio) ,  proceed 

as  follows.  First,  compute  the  "adjusted  total  sum  of  squares," 

2 

SSTjadjj  =  y'y  -  (Ey^  /n,  where  y'y  is  stored  in  register  78, 
Ey^  in  register  71*  and  n  in  register  08  at  the  first  step  of 
Program  1.  Then 
1 - 

See  Comment  in  Figure  3 . 
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TITLE  flBBBSg  «CWSSIOW-FGM  »X  PAGE  1 _ 0F_1 _  T1  RogronYTKible 

PROGRAMMER _ BAM _ DATE  _  PfOgfQm  Record 


Partitioning  (Op  17)  I  .s.T.D.  I  Library  Modulo  MASTtR 


PROGRAM  DESCRIPTION 


Printer  OPTIOHAL  Cafds  1 


(Banks  1,2) 


for  ths  general  linear  hypothssis  model  Y  ■  X0  ♦  c,  calculates:  x'x,  x'y,  y'y, 

| x'x| ,  (x'x)-1,  8,  0'x'y,  ly^.  Program  can  handle  up  to  7  indapandant  variablss. 
Running  tins  incraasas  as  tha  dimension  k  of  x'x  incraasas.  Any  number  n  of 
data  points  can  ba  accommodated. 


USER  INSTRUCTIONS 


STEP 


PROCEDURE 


ENTER 


PRESS 


DISPLAY 


Initialize 

Inter  rows  of  (x  !  y) 


|xn-R/S;  x. 


IP 


E 

KfSj . 


(repeat  above  sequence  until  all  rows  entailed).* 

Display  x'x,  x'y,  y'y,  Iy4  (or  use  "INV  l|lST"  with  prjtate^) 

is  n) 


#71  -  (70  +  k):  x'y.  (BOTE:  #71  is  ly^) 


#06  -  (07  +  k  ):  columns  of  x'x  (note:  #0q 
#71  -  (7< 

#78*  y'y 

Note*  save  x'x  and  x'y  on  cards  if  "reduced  nodal1 
Ccxnpute  6 

(with  printer,  |x'x[  is  printed) 


Display  0,  0'x'y,  (x'x)  **  Recall  (or  use 
#08  -  (07  +  k2) :  Columns  of  (x'x)  1  in  perrii 
stored  in  #(08  +  k2)  -  (0*j 
(#08  +  k2  +  k)  -  (07  +  k2  +  2k) :  0 
#71  -  (70  ♦  k) :  x'y 
#79:  B'x'y 


INV  LIST"  w/prir  ter)| 
luted  order — Drder  of  ^enmftation 
+  k2  +  k) 


M  x. 


is  qesi] 
C 


4n 


■*  R/s;  y^R/S 


next  row  index 


rkd  (] 


l^anks  2,3,4) 
1  • 


USER  0EFINED  KEYS 


DATA  REGISTERS 


LABELS (Op 08)  (see  listing) 


•  x'x  update 

c  i  computation 
o 

i  Initialize 


ALL  USED: 
PARTITIONING 


1Y 


Bif  an  error  in  ent 
cand  re-enter  the  d^ 
°before  pressing  "B 


^is  made,  press  ".SBR  .015" 
it  a  row.  This  must  b±  done 

i  i 

i  i 


i INTERNAL 

T6  319.79 
* 


[MV]  _5eil  _  [ttj  „  ‘jci*  .  {*ritj  1  **' 

far  Pal  gg)  l»g  _  rr :  _ 

1C  ,.03 -LU  _C±:^ls§~C£3_ 
MS_.CZ]..-®]  -.  DC  _  231  _  CZ)  - . 

(5tl_S-BD_.ini  -  D  - s 

oi  _ob  _  »iD  a  -  ea  a 


FLAGS 


C  H77  Inn  intmpTtePtt  i» 


i 


FIGURE  1 
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Tl  Programmable  , 

Program  Record 


Provided  the  first  column  of  X  is  a  vector  of 


SSE 


SST 


R  = 


(adj) 


SST 


(adj) 


where  the  sum  of  squares  due  to  error  is  given  by 


SSE  =  y'y  -  B'x'y  =  (n-k) a2 


4.  Example .  (k  =  3  example  from  the  TI  "Applied  Statistics" 
module  booklet;  page  5-15)  t; 

(1)  Read  in  Program  #1,  banks  1  and  2, 

(2)  enter  "3',  press  E, 

(3)  enter  first  row  of  (x  I  y) ,  as  follows  (do  not  forget  the 
"l"  corresponding  to  the  constant  term) : 

1/  R/S,  0,  R/S,  0,  R/S,  17. 3 ,  R/S,  B  (next  row  index  displays) 

(repeat  this  sequence ,  entering  9  rows  of  data  as  in 
Table  5.2,  which  we  produce  in  Table  1  for  convenience. 


row  number 


1 

2 

3 

4 

5 

6 

7 

8 
9 


1 

1 

1 

1 

1 

1 

1 

1 

1 


0 

0 

0 

1 

1 

1 

2 

2 

2 


dependent  variable 


0 

1 

2 

0 

1 

2 

0 

1 

2 


17.3 
18.1 
18.7 
18.6 
19.1 

19.5 

19.6 
19.9 

20.3 


Table  1 


(4)  write  banks  2,  3,  4  to  save  x'x,  x'y  if  tests  of  hypotheses 
about  coefficients  are  desired  (see  listings  below) .  Save 
y'y  (register  78)  and  Ey^  (register  71) , 

(5)  press  C  to  compute  B,  S' x'y,  (x'x)  , 

(6)  recall  and  note  desired  components,  as  follows  (see  listing 
below) 

a)  columns  of  (x'x)  ^  in  registers  08  to  16,  order  of 
columns  permuted;  permutation  stored  in  17,  18,  19 

A 

b)  6  in  registers  20 ,  21,  22 

c)  x'y  in  registers  11,  12,  73 

d)  y'y  (total  sum  of  squares)  in  register  78 

e)  3'x'y  (sum  of  squares  due  to  regression)  in  register  79. 

(7)  To  test  H^ra^  =  0  (for  example)  reduce  model  to  eliminate 
the  first  independent  variable  as  follows: 

a)  read  in  data  (stored  at  step  2)  in  banks  2,  3,  4 

b)  read  in  Program  #2,  bank  1 

c)  enter  the  variable  to  be  deleted  ("l”  in  this  case) , 
press  A 

d)  when  computation  is  complete,  Press  B  to  compute  the  reduced 
sum  of  squares  due  to  regression 

e)  when  computation  is  complete,  the  sum  of  squares  due 
to  regression  in  the  reduced  model  3^.  (x'y)  (where 
"r"  means  ’’reduced"  )  ,  is  displayed  and  is  stored  in 
register  79. 


f)  The  F-ratio  for  testing  HQ:a0  ■  0  is  formed  as  follows 


3'x'y  -  ei(x'y)„ 

- r - —  =  2705.2 


(y'y  -  e'x'y)/(n-k) 


degrees  of  freedom  are  1  and  (n-k)  =  6. 


(7»)  If  it  is  desired  to  test  other  hypotheses  of  the  form 


Hgta^  =  0,  repeat  the  steps  in  (7)  above,  with  appropriate 


are  jointly  zero,  =  a^  =  •••  _m 


entry  of  "i"  at  step  (7c).  (Step  (7b)  need  not  be  repeated.) 

(7")  It  is  desired  to  test  a  hypothesis  that  several  coefficients 

=  a_  =  0 ,  repeat 
step  (7c)  for  each  variable  to  be  deleted,  in  descending 
order  of  magnitude  of  the  subscripts.  In  this  case,  the 
F-ratio  shown  in  (7f)  should  be  divided  by  the  number  (say  s) 
of  remaining  variables,  and  the  F  statistic  has  s  and 
n-k  degrees  of  freedom. 

(8)  Values  obtained  for  the  example  and  the  hypothesis  illustrated 
in  step  (7)  are  shown  on  the  attached  printouts.  A  summary 
AOV  table  is  shown  in  Table  2. 


! 

i 

i 

v 


Source  df  SS  F 


Regression:  full 

reduced 

3 

2 

3259.7161 

2565.8327 

693.88  ^ 

.1539/6 

due  to 

1 

693.8834 

Total 

9 

3259.87 

a  2 

Error 

6 

(3259. 87-3259. 7161) =.1539 

a  =  .1539/6 

APPENDIX  1 

PROGRAM  LISTINGS 

Note:  Program  #1  is  recorded  with  standard  partitioning; 
when  run  it  internally  partitions  the  calculator  to  319.79. 
Program  #2  and  data  cards  storing  x'x  and  x'y  (if  written) 
are  written  with  319.79  partitioning. 

If  it  is  desired  to  write  Program  #1  after  it  has  been 
run,  repartition  back  to  standard  format  prior  to  writing 
(enter  6,  press  "2nd  OP  17"). 


PROGRAM  1 
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35 

1/X 

227 

08 

8 

179 

07 

7 

228 

85 

+ 

180 

00 

0 

229 

43 

RCL 

181 

85 

+ 

230 

07 

07 

182 

43 

RCL 

231 

33 

X* 

183 

03 

03 

232 

85 

+ 

184 

54 

> 

233 

43 

RCL 

185 

42 

STO  . 

234 

07 

07 

186 

02 

02 

235 

85 

+ 

187 

08 

8 

236 

43 

RCL 

188 

85 

+ 

237 

01 

01 

189 

43 

RCL 

238 

54 

> 

190 

07 

07 

239 

42 

STD 

191 

85 

+ 

240 

02 

02 

192 

43 

RCL 

241 

07 

< 

193 

07 

07 

242 

01 

1 

194 

33 

X  E 

243 

OCT 
•-.*  J 

+  ' 

195 

85 

+ 

244 

43 

RCL 

196 

43 

RCL 

245 

01 

01 

197 

04 

04 

246 

54 

> 

198 

54 

) 

247 

42 

STD 

199 

42 

STD 

248 

05 

05 

200 

05 

05 

249 

73 

RC* 

201 

73 

RC* 

250 

02 

02 

202 

02 

02 

251 

65 

X 

203 

72 

ST* 

252 

73 

RC* 

204 

05 

C  5 

253 

05 

05 

205 

43 

RCL 

254 

54 

) 

206 

07 

07 

|L_  -U1  •— 1 

44 

SUM 

207 

32 

XI T 

256 

79 

79 

208 

43 

RCL 

257 

69 

DP 

209 

03 

03 

258 

21 

21 

210 

67 

EQ 

259 

43 

RCL 

211 

23 

LNX 

260 

07 

07 

212 

69 

DP 

261 

32 

XI T 

213 

£  C* 

262 

43 

RCL 

214 

61 

GTO 

263 

01 

01 

215 

“l 

*-■ 

X* 

264 

V  V 

INV 

216 

76 

LBL 

265 

i  l 

GE 

217 

23 

LNX 

266 

24 

CE 

218 

25 

CLR 

267 

25 

CLR 

219 

36 

PGM 

268 

36 

PGM 

220 

02 

02 

269 

02 

02 

221 

15 

E 

270 

17 

B* 

222 

00 

0 

271 

91 

R/S 

223 

42 

STD 

00 

0 

224 

01 

01 
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00 

o 
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LBL 
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97 
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07 
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54 
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03 

0  3 

028 

71 
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92 

RTN 
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76 

LBL 
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42 

STO 
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06 

06 

035 

65 
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43 

RCL 
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07 

038 
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08 

8 
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54 
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STD 
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75 

- 

045 
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046 

07 

07 

047 

54 
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42 

STO 
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04 

04 
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71 
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10 

E’ 
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0  8 
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054 

43 

RCL 
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056 

54 
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42 
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54 
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75 

- 
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54 
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42 
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02 
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17 
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